York County
Robotic versus Human Teleoperation for Remote Ultrasound
Black, David, Salcudean, Septimiu
Abstract--Diagnostic medical ultrasound is widely used, safe, and relatively low cost but requires a high degree of expertise to acquire and interpret the images. Personnel with this expertise are often not available outside of larger cities, leading to difficult, costly travel and long wait times for rural populations. T o address this issue, tele-ultrasound techniques are being developed, including robotic teleoperation and recently human teleoperation, in which a novice user is remotely guided in a hand-overhand manner through mixed reality to perform an ultrasound exam. These methods have not been compared, and their relative strengths are unknown. Human teleoperation may be more practical than robotics for small communities due to its lower cost and complexity, but this is only relevant if the performance is comparable. This paper therefore evaluates the differences between human and robotic teleoperation, examining practical aspects such as setup time and flexibility and experimentally comparing performance metrics such as completion time, position tracking, and force consistency. It is found that human teleoperation does not lead to statistically significant differences in completion time or position accuracy, with mean differences of 1.8% and 0.5%, respectively, and provides more consistent force application despite being substantially more practical and accessible. Remote and under-resourced communities have far worse access to healthcare than larger cities [1], [2]. Ultrasound has become one of the most prevalent diagnostic imaging modalities due to its relatively low cost, non-invasive nature, and lack of radiation [3], but many communities have very limited access to qualified sonographers.
- North America > Canada > British Columbia > Metro Vancouver Regional District > Vancouver (0.40)
- Europe > Germany > Bavaria > Upper Bavaria > Munich (0.04)
- North America > United States > South Carolina > York County > Rock Hill (0.04)
- (3 more...)
- Research Report > Experimental Study (1.00)
- Research Report > New Finding (0.68)
Effect of Performance Feedback Timing on Motor Learning for a Surgical Training Task
Gale, Mary Kate, Baker-Matsuoka, Kailana, Nisky, Ilana, Okamura, Allison
Objective: Robot-assisted minimally invasive surgery (RMIS) has become the gold standard for a variety of surgical procedures, but the optimal method of training surgeons for RMIS is unknown. We hypothesized that real-time, rather than post-task, error feedback would better increase learning speed and reduce errors. Methods: Forty-two surgical novices learned a virtual version of the ring-on-wire task, a canonical task in RMIS training. We investigated the impact of feedback timing with multi-sensory (haptic and visual) cues in three groups: (1) real-time error feedback, (2) trial replay with error feedback, and (3) no error feedback. Results: Participant performance was evaluated based on the accuracy of ring position and orientation during the task. Participants who received real-time feedback outperformed other groups in ring orientation. Additionally, participants who received feedback in replay outperformed participants who did not receive any error feedback on ring orientation during long, straight path sections. There were no significant differences between groups for ring position overall, but participants who received real-time feedback outperformed the other groups in positional accuracy on tightly curved path sections. Conclusion: The addition of real-time haptic and visual error feedback improves learning outcomes in a virtual surgical task over error feedback in replay or no error feedback at all. Significance: This work demonstrates that multi-sensory error feedback delivered in real time leads to better training outcomes as compared to the same feedback delivered after task completion. This novel method of training may enable surgical trainees to develop skills with greater speed and accuracy.
- North America > United States > California > San Francisco County > San Francisco (0.14)
- North America > United States > South Carolina > York County > Rock Hill (0.04)
- North America > United States > California > Santa Clara County > Stanford (0.04)
- (3 more...)
- Research Report > New Finding (1.00)
- Research Report > Experimental Study > Negative Result (1.00)
- Health & Medicine > Surgery (1.00)
- Education > Curriculum > Subject-Specific Education (0.41)
Measurement and Potential Field-Based Patient Modeling for Model-Mediated Tele-ultrasound
Yeung, Ryan S., Black, David G., Salcudean, Septimiu E.
Teleoperated ultrasound can improve diagnostic medical imaging access for remote communities. Having accurate force feedback is important for enabling sonographers to apply the appropriate probe contact force to optimize ultrasound image quality. However, large time delays in communication make direct force feedback impractical. Prior work investigated using point cloud-based model-mediated teleoperation and internal potential field models to estimate contact forces and torques. We expand on this by introducing a method to update the internal potential field model of the patient with measured positions and forces for more transparent model-mediated tele-ultrasound. We first generate a point cloud model of the patient's surface and transmit this to the sonographer in a compact data structure. This is converted to a static voxelized volume where each voxel contains a potential field value. These values determine the forces and torques, which are rendered based on overlap between the voxelized volume and a point shell model of the ultrasound transducer. We solve for the potential field using a convex quadratic that combines the spatial Laplace operator with measured forces. This was evaluated on volunteer patients ($n=3$) by computing the accuracy of rendered forces. Results showed the addition of measured forces to the model reduced the force magnitude error by an average of 7.23 N and force vector angle error by an average of 9.37$^{\circ}$ compared to using only Laplace's equation.
- North America > United States > South Carolina > York County > Rock Hill (0.04)
- North America > United States > California (0.04)
- North America > Canada > Ontario > Waterloo Region > Waterloo (0.04)
- Europe > Netherlands > North Holland > Amsterdam (0.04)
Linearity, Time Invariance, and Passivity of a Novice Person in Human Teleoperation
Black, David, Salcudean, Septimiu
Low-cost teleguidance of medical procedures is becoming essential to provide healthcare to remote and underserved communities. Human teleoperation is a promising new method for guiding a novice person with relatively high precision and efficiency through a mixed reality (MR) interface. Prior work has shown that the novice, or "follower", can reliably track the MR input with performance not unlike a telerobotic system. As a consequence, it is of interest to understand and control the follower's dynamics to optimize the system performance and permit stable and transparent bilateral teleoperation. To this end, linearity, time-invariance, inter-axis coupling, and passivity are important in teleoperation and controller design. This paper therefore explores these effects with regard to the follower person in human teleoperation. It is demonstrated through modeling and experiments that the follower can indeed be treated as approximately linear and time invariant, with little coupling and a large excess of passivity at practical frequencies. Furthermore, a stochastic model of the follower dynamics is derived. These results will permit controller design and analysis to improve the performance of human teleoperation.
- South America > Uruguay > Artigas > Artigas (0.04)
- North America > United States > South Carolina > York County > Rock Hill (0.04)
Visual-Haptic Model Mediated Teleoperation for Remote Ultrasound
Black, David, Tirindelli, Maria, Salcudean, Septimiu, Wein, Wolfgang, Esposito, Marco
Tele-ultrasound has the potential greatly to improve health equity for countless remote communities. However, practical scenarios involve potentially large time delays which cause current implementations of telerobotic ultrasound (US) to fail. Using a local model of the remote environment to provide haptics to the expert operator can decrease teleoperation instability, but the delayed visual feedback remains problematic. This paper introduces a robotic tele-US system in which the local model is not only haptic, but also visual, by re-slicing and rendering a pre-acquired US sweep in real time to provide the operator a preview of what the delayed image will resemble. A prototype system is presented and tested with 15 volunteer operators. It is found that visual-haptic model-mediated teleoperation (MMT) compensates completely for time delays up to 1000 ms round trip in terms of operator effort and completion time while conventional MMT does not. Visual-haptic MMT also significantly outperforms MMT for longer time delays in terms of motion accuracy and force control. This proof-of-concept study suggests that visual-haptic MMT may facilitate remote robotic tele-US.
- Europe > Germany > Bavaria > Upper Bavaria > Munich (0.04)
- North America > United States > South Carolina > York County > Rock Hill (0.04)
- North America > United States > California > Santa Clara County > Santa Clara (0.04)
- North America > Canada > British Columbia > Metro Vancouver Regional District > Vancouver (0.04)
WavePulse: Real-time Content Analytics of Radio Livestreams
Mittal, Govind, Gupta, Sarthak, Wagle, Shruti, Chopra, Chirag, DeMattee, Anthony J, Memon, Nasir, Ahamad, Mustaque, Hegde, Chinmay
Radio remains a pervasive medium for mass information dissemination, with AM/FM stations reaching more Americans than either smartphone-based social networking or live television. Increasingly, radio broadcasts are also streamed online and accessed over the Internet. We present WavePulse, a framework that records, documents, and analyzes radio content in real-time. While our framework is generally applicable, we showcase the efficacy of WavePulse in a collaborative project with a team of political scientists focusing on the 2024 Presidential Elections. We use WavePulse to monitor livestreams of 396 news radio stations over a period of three months, processing close to 500,000 hours of audio streams. These streams were converted into time-stamped, diarized transcripts and analyzed to track answer key political science questions at both the national and state levels. Our analysis revealed how local issues interacted with national trends, providing insights into information flow. Our results demonstrate WavePulse's efficacy in capturing and analyzing content from radio livestreams sourced from the Web. Code and dataset can be accessed at \url{https://wave-pulse.io}.
- Asia > Middle East > UAE > Abu Dhabi Emirate > Abu Dhabi (0.14)
- North America > United States > New York > Kings County > New York City (0.04)
- North America > United States > Washington > King County > Seattle (0.04)
- (215 more...)
- Media > Radio (1.00)
- Leisure & Entertainment (1.00)
- Government > Voting & Elections (1.00)
- Government > Regional Government > North America Government > United States Government (1.00)
Stability and Transparency in Mixed Reality Bilateral Human Teleoperation
Black, David Gregory, Salcudean, Septimiu
--Recent work introduced the concept of human teleoperation (HT), where the remote robot typically considered in conventional bilateral teleoperation is replaced by a novice person wearing a mixed reality head mounted display and tracking the motion of a virtual tool controlled by an expert. HT has advantages in cost, complexity, and patient acceptance for telemedicine in low-resource communities or remote locations. However, the stability, transparency, and performance of bilateral HT are unexplored. In this paper, we therefore develop a mathematical model and simulation of the HT system using test data. We then analyze various control architectures with this model and implement them with the HT system to find the achievable performance, investigate stability, and determine the most promising teleoperation scheme in the presence of time delays. We show that instability in HT, while not destructive or dangerous, makes the system impossible to use. However, stable and transparent teleoperation are possible with small time delays ( < 200 ms) through 3-channel teleoperation, or with large time delays through model-mediated teleoperation with local pose and force feedback for the novice. Many remote and underresourced communities experience severe challenges in accessing qualified medical care. For example, ultrasound imaging is important, widely used, and much lower cost than other modalities such as CT or MR. However, capturing and interpreting ultrasound images requires a high degree of expertise that is not commonly present in many small communities. As a result, a sonographer or radiologist must be transported to the town on a regular basis, or patients must be sent to a major medical center. Either case leads to long wait times and difficulty handling urgent cases. In communities across Canada, patients are flown hundreds of kilometers for standard ultrasound exams. This takes up to three days and exerts a high social and financial cost on the community. Therefore, tele-ultrasound is an important and growing field. However, current commercially available technologies are often impractical. Video teleguidance is simple, low-cost, and accessible to anyone but is highly inefficient and imprecise if the person being guided does not already have ultrasound experience [1]. On the other hand, robotic teleultrasound gives the physician complete and precise control but is expensive and complex to set up and maintain. We thus recently introduced a novel teleguidance method called human teleoperation to address the shortcomings of both existing approaches [1], [2]. This method is also applicable to many other remote guidance applications. In human teleoperation, a local novice, the "follower", performs an ultrasound exam on a patient while being guided by a remote operator, the sonographer or radiologist. The follower wears a mixed reality (MR) head-mounted display (HMD) which projects a virtual ultrasound probe into their field of view.
- North America > United States > South Carolina > York County > Rock Hill (0.04)
- North America > United States > Massachusetts > Middlesex County > Natick (0.04)
- North America > Canada > British Columbia (0.04)
- Health & Medicine > Diagnostic Medicine > Imaging (0.86)
- Health & Medicine > Nuclear Medicine (0.54)
- Health & Medicine > Health Care Providers & Services (0.54)
Mixed Reality Tele-ultrasound over 750 km: a Clinical Study
Yeung, Ryan, Black, David, Chen, Patrick B., Lessoway, Victoria, Reid, Janice, Rangel-Suarez, Sergio, Chang, Silvia D., Salcudean, Septimiu E.
Ultrasound is a hand-held, low-cost, non-invasive medical imaging modality which plays a vital role in diagnosing various diseases. Despite this, many rural and remote communities do not have access to ultrasound scans due to the lack of local experts trained to perform them. To address this challenge, we built a mixed reality and haptics-based tele-ultrasound system to enable an expert to precisely guide a novice remotely in carrying out an ultrasound exam. The precision and flexibility of our solution makes it more practical than existing tele-ultrasound solutions. We tested the system in Skidegate on the islands of Haida Gwaii, BC, Canada, with the experts positioned 754 km away at the University of British Columbia, Vancouver, Canada. We performed 11 scans with 10 novices and 2 experts. The experts were tasked with acquiring 5 target images and measurements in the epigastric region. The novices of various backgrounds and ages were all inexperienced in mixed reality and were not required to have prior ultrasound experience. The captured images were evaluated by two radiologists who were not present for the tests. These results are discussed along with new insights into the human computer interaction in such a system. We show that human teleoperation is feasible and can achieve high performance for completing remote ultrasound procedures, even at a large distance and with completely novice followers.
- North America > Canada > British Columbia > Metro Vancouver Regional District > Vancouver (0.34)
- North America > Canada > British Columbia > Haida Gwaii (0.24)
- South America > Brazil > São Paulo (0.04)
- (3 more...)
How Companies Are Using AI to Alleviate Labor Shortages
Three of every four companies have reported talent or labor shortages and difficulty hiring–a 16-year high. Profound social, economic and demographic changes have created unmet demands for workers in industries ranging from hospitality to logistics to healthcare. Executives across sectors are struggling to attract and retain talent and it's likely that labor shortages will remain a critical issue for many organizations moving forward. However, the rapid advances in artificial intelligence (AI) have the potential to significantly disrupt labor markets. Leading organizations are using AI technologies to reduce the impact of labor shortages and improve their competitive position, while also saving on costs. Here's how they're putting AI and big data to use: Some say a non-supportive and unpleasant work environment is the reason their employees quit, creating labor shortages.
Artificial intelligence takes center stage at chamber event
The Greater Summerville Chamber of Commerce along with Dorchester Economic Development held a virtual, Industry Appreciation event. The virtual gathering, presented by TD Bank, took on the challenging subject of Artificial Intelligence (A.I.). Cathy Hayes from the South Carolina Research Authority, began discussing the modern industrial revolution or Industry 4.0, by saying, when it comes to adopting A.I. companies need to start small and foster a modern culture with a fresh mindset. Traditional thinkers are not welcome and for good reason. Artificial Intelligence has already arrived in everyday life.